FIRE: Forum for Information Retrieval Evaluation

نویسندگان

  • Mandar Mitra
  • Prosenjit Majumdar
چکیده

This talk will present our plans for organizing FIRE, a forum for Information Retrieval evaluation, focused on Indian languages. We will start by reviewing the basic experimental framework and metrics as represented by the Cranfield paradigm. An overview of the main evaluation fora for IR -TREC, CLEF and NTCIR, which are all based on this paradigm, and from which FIRE draws inspiration -will be given. The components of the evaluation framework, viz. corpora, search topics, and relevance judgments will also be discussed.

برای دانلود رایگان متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Semi-automatic keyword based approach for FIRE 2016 Microblog Track

This paper describes our semi-automatic keyword based approach for the four topics of Information Extraction from Microblogs Posted during Disasters task at Forum for Information Retrieval Evaluation (FIRE) 2016. The approach consists three phases;

متن کامل

An Information Retrieval System for FIRE 2016 Microblog Track

This paper describes our approaches to FIRE (Forum for Information Retrieval Evaluation) 2016 Microblog track. The main aim of this track was to develop an information retrieval system that can identify relevant tweets posted during a disaster event. The relevance is measured with respect to some predefined topics provide by the track organizers. In this working note we have given the descripti...

متن کامل

Word Embeddings for Information Extraction from Tweets

This paper describes our approach on “Information Extraction from Microblogs Posted during Disasters”as an attempt in the shared task of the Microblog Track at Forum for Information Retrieval Evaluation (FIRE) 2016 [2]. Our method uses vector space word embeddings to extract information from microblogs (tweets) related to disaster scenarios, and can be replicated across various domains. The sys...

متن کامل

Maryland at FIRE 2011: Retrieval of OCR'd Bengali

In this year's Forum for Information Retrieval Evaluation (FIRE), the University of Maryland participated in the Retrieval of Indic Script OCRed Text (RISOT) task to experiment with the retrieval of Bengali script OCR’d documents. The experiments focused on evaluating a retrieval strategy motivated by recent work on Cross-Language Information Retrieval (CLIR), but which makes use of OCR error m...

متن کامل

Theme Based English and Bengali Ad - hoc Monolingual Information Retrieval in FIRE 2010

This paper presents the experiments carried out at Jadavpur University as part of the participation in the Forum for Information Retrieval Evaluation (FIRE) 2010 in ad-hoc mono-lingual information retrieval task for English and Bengali languages. The experiments carried out by us for FIRE 2010 are based on stemming, zonal indexing, theme identification, TF-IDF based ranking model and positional...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2008